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ABSTRACT 

The objective of this study was to develop and 
evaluate two procedures for providing preschool education for rural 
4-year-olds by using a mobile laboratory-. The project used 
**readinobiles** to determine the effectiveness of a structured, 
psycholinguistically-based preschool curriculum on black, 
disadvantaged children. There were three treatment groups: (1) 
advantaged white children receiving a general enrichment program, (2) 
disadvantaged black children receiving three months of lessons from 
the Peabody language Development Kit, and (3) disadvantaged black 
children receiving nine months of the Peabody program. Each child in 
these treatment groups was matched to a control child by age, race, 
sex, and sociceconomic status. Both groups were posttested twice (to 
determine reliability) on the Stanford-Binet, the Caldwell Preschool 
Inventory and the Illinois Test of Psycho linguistic Abilities. The 
results showed that the experimental subjects were superior to the 
control subjects on all measures. The treatment groups also differed 
significantly from one another. Finally, subjects in all groups 
scored significantly higher on the second posttest. The final report 
of this document submitted to the Office of Economic Opportunity 
appeared as ED 039 022. (HH) 
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PROBLEM 



During the last decade numerous federal and state agencies have 
developed programs designed to improve the lives of socio-economically 
disadvantaged Americans^ Special assistance has come through increased 
job opportunities, medical aid, social services, and educational pro- 
grams. The young child represents the target population for both pre- 
ventative (e.g. , Schaefer, 1965) and remedial (Gordon, 1967) educa- 
tional programs designed to modify the effects of poverty on the indi- 
vidual; 

Support for the interest of early childhood educators and psycho- 
logists in modifying the cognitive-intellectual abilities of young’ chil- 
dren has a base in contemporary theorizing (Hunt, 1961) and the empirical 
research literature (Elkind, 1967). Hunt (1961) carefully outlines a con 
ception , of ' intelligence in which intelligence is .not viewed as constant, 
nor i's it necessarily doomed to develop in a fixed, unmodifiable way. 
Considerable data are cited to support the contention that intelligence 
and intellectual development can be modified by means of , environmental 
events. On a more applied level, .programs like Project Head Start are 
based on the assximpti.on that preschool experiences can facilitate 
school performance of the young socio-economically disadvantaged child. 

The rapid growth of preschool educational programs in North 
America (R.eidford, 1968) dr^miatically underscor.es the. ma^or problem of 
preschooX education today; . it is an ^edifice without a foundation! Mbre 
specific, ally, due to the lack Of scientific research in the area, we dan 
only make educated guesses abou.t the important variables that influence 
cognitive and intellectual development during the preSchool years (White, 
1968). The current lack of scientific information stems &om two 'sources 
one Historical and one contemporary. Historically,, little research was 
conducted on preschool programs except, for those investigations of kinder 
garten programs for sociq-economically advantaged, children (Swift, .1964). 
Almost all of this early research suffered on several important counts, 
(e.g. , confounded experimenfal design) ,' so that .generalizations about the 
merits of nursery school attendance cannot be made because of the incon- 
clusive and contradictory research data. 

The contemporary status of preschool education presents a 
somewhat mixed picture. On the one hand, numerous psychologists and 
educators are turning their attention to the general area of preschool 
education and to the specific area of preschool education for socio- 
economically disadvantaged children (Deutsch, Katz, & Jensen, 1968; 
Helmuth, 1967; Hess & Bear, 1968; and Webster, 1966). There are at 
least two noticeable negative by-products from this surge of interest 
in preschool education; (1) Hundreds of preschool programs exist 



that either have no clear statenent of curriculum and/or do not have 
an adequate evaluation component. These efforts are, therefore, 
basically useless in contributing to a scientific understanding of 
the important variables in preschool education. (2) Dozens of 
connercially prepared preschool educational materials have appeared 
that have not been adequately field tested. It is understandable 
that publishers develop materials for the current "fad" of preschool 
education and that authors wish to share their "educated gueases" with 
the world; however, extreme caution needs to be exercised in the use 
of these materials. 

During the last few years, dozens of programs in urban settings 
have been developed that look promising. An urgent need now exists 
for independent assessments of all major preschool curricula and an 
evaluation of their effects on a variety of subject populations (e.g. , 
rural children). The following prototype programs, in my Judgment, 
illusr t, . i promising research directions that need to be independently 
evalu^ ' • and extended: (1) birth to two*year*olds - language Tutorial 

(Schaefer, 1965); Parent Education Project (Gordon, 1967); Project Know 
(Parker & Dunham, 1968); Painter Hose Tutorial (1968); (2) two- to 
five-year-olds - Early Training Project (Gray & Klaus, 1965); Structured 
Psychodiagnostic Program (Karnes, Kirk, Bereiter & Englemann, 1968); 
Academic Preschool ^proach (Itereiter & Englemann, 1966); Learning to 
Learn School (Sprigle, 1967). 

These programs were mentioned because, in general, they have 
(1) specified their curricula, (2) outlined their theoretical orien- 
tation, (3) provided a research evaluation of their program, and (4) 
prod^jtced encouraging results in terms of facilitating cognitive- 
intellectual development of the participants. 

The present research uses the Peabody Language Development Kit 
(PLDK), Level #P, because (1) the materials are based on psycholinguistic 
theory, (2) the Peabody materials for older children (Levels K, 1, and 2) 
have produced .Inqsressive results (see the manuals for these three kits 
for a comprehensive review of the relevant research, Aaierican Gbidance 
Service), and (3) the format of the lesson is ideal for paraprofessional , 
teachers to use. The FIDK model was built on Osgood's linguistic theory 
(1957) which also formed the base of the Illinois Test of Psycholinguistic 
Abilities (Kirk & McCarthy, 1961). The theoretical model on the nature 
and training of human intellect by Guilford (1967) was drawn upon in 
addition to the work of Torrance (1962) in the area of creative . think- 
ing. In all four levels (Level #P, iHC, #1, and #2) the training of 
global oral language rather than specific training on selected psychor 
linguistic processes is stressed. Nhile activities exist for all three 
con^onents of language, namely reception, expression, and conception, 
in Level #P stress was placed on auditory reception and on vocal 
expression. Emphasis is placed on the establishment of an automatic 
level of sentence structure reflecting basic syntactical rules. 
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The rationale for the Kies was based, as well, on. theory and 
research related to verbal learning (HcGeoch & Irion, 1932) < An 
attempt was made to cast the lessons in keeping with the behavior 
modif ication techniques- of Skinner (1957)< In addition to the use 
'>f tangible and token reinforceoients, motivation was also built in 
(1) by having many of the daily lessons contain an activity which 
allowed for free movement on the part of the group; (2) by providing 
attractive, full-color pictures as well as novel and intriguing 
records, puppets,' magnetic shapes and other materials; (3) by pacing 
the activities so as to move on when interest lagged; (4) by having 
as many as possible of the children engaged in all activities at all 
times; and (5) by selecting eleoients which were found in field test- 
ing to be of high interest value to most children for' whom this level 
of the Kit was devised* The various aspects of language taught by 
the lessons were programmed for increasing difficulty, though future 
field testing will probably demonstrate the need for further refine- 
ments in this regard* Finally, behavior theory and research was 
called upon in building overlearning into the lessons (Ellis, 1963; 
Vergason, 1964)* 

No atten^t is made here to review the research on Level #K, 
Level #1, and Level #2 of the Peabody series. This literature is 
carefully sumnarized in the manuals of the appropriate level of the 
Kits. Levels #K, #1 and #2 of the PLDK series appear to be effec- 
tive in stimulating oral language development* The evidence is less 
clear on the usefulness of the lessons in training intellect and 
enhancing school achievement— with some notable successes in both 
cases* 



Regarding the research on Level #P of the PLDK, approximately 
45 Kits of experimental edition of PLDK Level #P were field tested* 
Of this total, 14 Kits were placed in situations in *i^ich extensive 
data were collected prior to and following the experimental use of 
the materials* 

These data were derived from measurements using one or more 
of the following tests! Peabody Picture Vocabulary Test (PPVT); 
Stanford- Bine t Form L-M (S-B) ; Illinois Test of Psycho linguistic 
Abilities (I!^A); and the Test of Granmar adapted from Berko (1958)* 
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The most extensively researched study was conducted in Nash- 
ville at a dny care center for four- and five-year-old children* 

The 25 experimental children at this center were compared with a 
control population of 28 children in the same age range at another 
Nashville comnunity center* The children in both groups were exposed 
to daily programs typical of the approach used in day care centers in 
the Nashville area. In addition, the experimental grotq> received 
lessons from the experimental version of Level #F of the PLDK* The 
children in the two groups were compared on the following tests: 

FFVT, S-B, ITFA and the Test of Grammar. After a seven-month treat- 
ment period, a con^arison of gain scores from pre- to posttesting 
on the Bihet yielded a gain of 9.6 points in the experimental groiq>, 
as contrasted to a loss of 2.3 points in the control group. The 
changes- in FFV.T performance were ‘l'12.0 and ‘l'7.8 IQ points for the 
experimental and control groups respectively* On the ITFA, the 
experimental group gained an average of 7*2 months, iriiile the con- 
trol group gained an average of 3.9 months in language age. The 
subtests on iriiich the experimental group made the greatest gains 
were Visual-Motor Association Cl'23*4 months). Auditory Decoding 
Cfl6*8 months), and Auditory-Vocal Association (i*12.8 months). 

They showed regression in one subtest, Auditory-Vocal Sequential 
(imnediate auditory memory for digits). By contrast, the control 
group showed regression in the following four of t!te nine subtests: 
Vocal Encoding (-5.8 months); Motor Encoding (-3.95 months); 

Auditory Vocal ^tomatic (-5.1 months); and Visual Motor Sequential 
(“1.5 months)* 

A more extensive analysis of the data on three of the nine 
subtests of the ITFA was carried out by Morris (1967). She com- 
pared the pre-and postprogram performance of the experimental and 
control groups on the Auditory-Vocal Association, the Auditory- 
Vocal Automatic, and the Vocal Encoding subtests of the ITFA. In 
addition, she studied the postprogram performance of the experimental 
group on the Test of Granmar (adapted from Berko, 1958) and correlated 
the scores from this latter test with the three ITFA sub tests scores. 
The results of the Morris study were as follows: 

1. Frior to the experimental period, both the experimental and 
control groups were substantially retarded in language age 
on each of the three ITFA subtests* The groups were essen- 
tially equivalent on the Auditory-Vocal Automatic and the 
Vocal Encoding subtests, but the language age of the esqieri- 
mental group exceeded that of the control group by about 11 
months on the Auditory-Vocal Association subtest. 
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2. After seven months of daily instructions with the Level #P 
lessons, a marked improvement in performance was noted among 
the experimental group on two of the three sub tests. The 
mean language age score reached approximated their age norm 
in one instance (Auditory-Vocal Association), and was four 
months nearer it in the other (Vocal Encoding), the control 
group, while gaining on the Auditory-Vocal Association sub- 
test in the saoie period, demonstrated statistically signifi- 
cant decreases in performance' on the other two subtests. 

3. Neither the group receiving language instruction nor the 
control group showed statistically significant improvement 
on the Auditory-Vocal Automatic subtest, which assessed the 
ability to apply granmatical rules, e.g. , "Here is a ball; 

here are two ' " The performance of both groups 

was also poor on the Grammar Test, idiidi was designed to 
assess the. same type of linguistic skills but with different 
test, material. Both groups were substantially below their 
age norms on both tests. 

A summary of the conclusions of Morris (1967) are as follows 
The language teaching device known as Level #P of the PUDK may' be 
expected to contribute to the development of certain expressive 
language skills to a much greater degree than the traditional pro- 
gram offered in day care centers for culturally deprived preschool 
children. However, in its present experimental form, it probably 
will not produce positive changes in such children with regard to 
their application of gransnatical rules for inflectional endings. 
Therefore, while facilitation of the language development of cultur 
ally deprived preschool children can be best enhanced with special 
language training, such as that provided by Level #P of the PLDK, 
additional types of teaching media will be required to improve 
specific gramnar skills unless such additional materials are in- 
corporated into the final version of the Kit. 

These findings led the authors to place heavy enq>hasis, in 
the final rewriting of Level #P> on activities which would promote 
positive changes in the syntactical and granmatical aspects of 
language-. Further research to test the effectiveness of the final 
version of the Kits in this regard is needed. 



A second study of the experimental edition of Level #P 
involved a group of 29 mentally retarded children in residence in 
a school in Wisconsin* These children were also given seven months 
of training with PLDK, Level #P. Their performance on the 1TPA» 
prior to the program and immediately after it, was coiq>ared. At 
the outset, all of the children fell in the M.A. range of three to 
five years and had IQ scores which generally clustered around 50. 

The total group was divided into three subgroups by virtue of their 
level of placement in the school program. The mean language age 
gain scores in months after seven months of the experimental edition 
of F1J)K #P lessons were 10.2, 14.2 and 14.0 months for the Adjustment, 
Pre-Kindergarten and Kindergarten groups respectively. The mean gains 
in language age for the total group on the nine ITPA subtests ranged 
from a low of 8.8 months (Auditory-Vocal Automatic and Auditory-Vocal 
Sequential) to a high of 30.5 months (Visual Motor Sequential). 

The Research to date on Level #P of the Peabody Language 
Development Kits has been based on the experimental version of the 
Kit and only on the first part of that version. Generally, the find- 
ings were heartening in terms of stimulating overall growth in oral 
language and verbal intelligence. However, the experimental edition 
did not stimulate grammatical-syntactical aspects of language to the 
extent desired. Therefore, in developing the final version, a much 
heavier concentration of exercises was included in this area and a 
series of' songs was devised to make certain syntactical rules auto- 
matic. Too, the final edition was expanded by about one-third. 

Each of the 180 daily lessons was divided in a Part A and a Part B, 
with two activities generally provided in each. Thus, the Kit now 
contains what could be described as 360 sublessons. It is hoped 
that the increased esqthasis on syntax and the extension of the train- 
ing program will overcome weaknesses discerned in the experimental 
edition. It remains for future research to advance knowledge about 
the effect ivextess of the Kit in its present form, especially with 
rega'^d to fostering graamiatic skills in disad^rantaged and retarded 
chiloren. The present research will provide an independent evalua- 
tion of Level #P using rural four-year-old disadvantaged children as 
subjects. 

In summary, the major problem of preschool education is to 
build itself a strong foundation based on enq>irical research. The 
following four-step approach appears to be a reasonable plan; (1) 
to continue developing prototype preschool curricula from various 
theoretical positions; (2) to design instructional systems to 
implement these curricula (e.g., multimedia, use of paraprofessionals, 
etc.); (3) to carefully evaluate these curricula before premature 
widespread adoption; and (4) to develop imaginative procedures to 
Implement curricula in special settings with different populations 
(e.g., rural children, school system with a low budget, advantaged 
and disadvantaged children, etc.). 
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The objective of the present proposal was to develop and 
evaluate two procedures for providing preschool education for 
rural four-year-olds by using a mobile lab. 

The Southeastern Educational Laboratory started a "readi- 
mobile" program during the 1967-68 school year (Toothman, 1968). 
The program's purpose is to "design, fidd test, and demonstrate 
the application of a. mobile instructional unit in providing readi- 
ness experiences to preschool age children in geographically 
isolated areas." The following guidelines exist for con^arable 
in^lementation of the Readimobile program in six Southeastern 
locations: 

1. Sites should be located fdiich provide easy access 
to the Readimobile for groups of about 13 children. 

2. The Readimobile program will visit each site twice 
weekly. 

Exclusive of Readimobile travel and preparation in 
tioie, each stop will be two hours in length. 

4. Each Readimobile is to be staffed by two para- 

professionals (indigenous high school graduates). 

In Wakulla County, Florida (the poorest county in Florida 
in terms of per capita income), the Readimobile stops at five 
locations — Shadeville, Sopchoppy, Crawfordville, Panacea and Buck- 
horn. The usual weekly Readimobile "Curriculum" can best be 
described as general cultural enrichment experiences provided 
basically thxough the use of films with supplementary introductory 
or follow-up activities. 

In June of 1968, Mr. Rex Toothman, Director of the Readi- 
mobile Program, asked me to react to the program. The essence of 
my comments can be sumnarized as follows: The program, while 

possibly providing a socialization function and serving to develop 
positive interpersonal relations, will probably fail to have any 
meaningful ^pact on the disadvantaged participants' cognitive- 
intellectual -language development and consequently his "readiness" 
for school. The general cultural enrichment experiences appear as 
vague and unstructured as those of similar programs that have 
failed to improve school readiness (Alpern, 1966). 
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These comnents, focusing on cognitive variables, are not meant 
to minimize the importance of gains in areas such as social-emotional 
development. BereitC'r ond Englemann (1966), however, provide convinc- 
ing arguments for focusing on specific deficits (e.g., language be- 
havior) of the disadvantaged children during the brief preschool day. 
Their argiuaent, simply put, is that we cannot help these children in 
all areas of development, so we must concentrate on those areas most 
likely to have high payoff in terms of stimulating cognitive- intel- 
lectual-language development and, consequently, school readiness. 

The purpose of this project was to compare the effectiveness 
of a structured psycholinguistically based preschool curriculum on 
disadvantaged black four-year-old children. One group (i^3) received 
instruction across a nine-month school year while another group (#2) 
received instruction for only three months. Additionally, the per- 
forms ncesrof these two groups were compared to a group (i^l) of advan- 
taged (by local standards) idiite children receiving the general 
enrichment curriculum of the Readimobile. Even though race and. 
curricula are experimentally confounded when comparing these three 
groups, our interest in adding the idiite children was to provide 
local ''norms" for comparison purposes. In essence, we were wonder- 
ing if our structured treatments would mask the often reported 
differences between black and white children on a variety of depen- 
dent measures. 
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PROCEDURES 



threer groups of eight four-year-old children served as the 
treated population in this study. Group 1, the general enrichment 
curriculum, is represented by children ^o participated in the 
standard 1963-1969 Readimobile Program at the Panacea location in 
Wakulla' County-'. A second group (Group 2) of the children at the 
Buckhorn location received lessons from the Peabody Language Develop- 
ment Kit, Level P (American Guidance Service, 1968) for the last 
three months of the 1968*69 program. Group 3, also the structured 
curriculum, is represented by the children who participated in the 
1968-69 Readimobile Program at the Shadeville location using the 
Peabody Language Development Kit for 9 months, the children in 
Group 1 were ^ite children from families with a median income of 
$4,500 and ^ose parents had a median of 12 years of education, 
the children- in Groups 2 and 3 were black chiUren whose families' 
median income- was below $3,000 and their parents' median education 
waS'8years. Each group was composed of five males and three fe- 
males. 

Bach child in the treated population was matched with an un- 
treated control child with respect to age (within three weeks), 
race, sex and socio-economic status. The control population was 
obtained from rural portions of adjoining Leon and Gadston Counties, 
which do not have a preschool program. None of the control children 
had ever attended a nursery school or any type of preschool program. 

The programs for Groups 1 and 3 started in September, 1968, 
and continued until June, 1969. The program for Group 2 lasted from 
March, 1969, until June, 1969. The Readimobile paraprofessional 
teachers, Mrs. Gray and Miss Taylor, were the same for all three 
groups. 



Contact hours for Group 1 were 8:00 - 12:00 a.m. on Wednes- 
day mornings. The daily schedule was quite flexible with a general 
enrichment curriculum including films with supplementary, intro- 
ductory- or follow-up activities. At the end of the 9-month program, 
the contact hours totaled 144. 

The contact hours for Group 2 (Peabody curriculum for three 
months) were 8:00 - 12:00 a.m. on Friday mornings with a schedule 
similar to that of Group 3, only including more lessons due to the 
four hours of contact in one day rather than four hours divided 
over two days. Group 2 met for a total of 48 hours of contact 
during the three months. 
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The contact hours for Group 3 (Peabody cuTriculum, nine 
months) were 9:00 - 11:00 a.m. on Ttiesday and Thursday mornings. 
A typical day's schedule is outlined as follows: 

9:00 - 9:20 Peabody Lesson 14A 

9:20 - 9:40 Peabody Lesson 14B 



9:40 - 10:00 



10:00 - 10:20 
10:20 - 10:40 



Outside structured Play 
(e.g., learn parts of the body, 
concepts such as near — far, up 
-- down, etc. while playing) 

Peabody Lesson 15A 

Peabody Lesson 15B 



10:40 - 11:00 



Remedial work on earlier lessons. 



Since Group 3 met only twice per week, the children did not cover all 
of the 180 lessons of the Peabody Kit during the nine months. How- 
ever, Group 3, like Group 1, met for a total of 144 contact hours. 



Evaluation 



Both internal and external evaluations were eaq>loyed to docu- 
ment the changes across time of Group 3 (Peabody Curriculum, nine 
months) and to determine if differences existed among the three 
treated groups and the three untreated groups on measures of intel- 
ligence, language, school readiness, and cognition. 

1. Internal Evaluation. The internal evaluation of Group 3 

(Peabody Curriculum) was accomplished by having two observ- 
ers (Hiss Lewy and Mr. Jennings) record each child's re- 
sponses to the Peabody Lessons (see Madsen & Madsen, 1969 for 
procedures). These data were to serve two purposes: (1) to 
document attainment levels of each child throughout the year 
and (2) to serve as diagnostic data for the teachers. With 
regard to the first purpose, this approach enabled us to not 
only keep accurate, up to date records on each child learn- 
ing progress on each concept, skill, or task, but also to 
identify the strengths and weaknesses of the curriculum 
materials on this subject population. For example, how many 
"trials" were necessary for these children to learn the mean- 
ing of "under — over," "up -- down," "big -- little." Many 
of these concepts and tasks were presented as a twenty minute 
lesson, yet we already had sufficient data to show that, on 
the average, much more time needs to be devoted to each of 
these lessons. 



The second purpose of the internal evaluation, diagnosis of 
attainment levels, enabled the teachers to group the children on 
each occasion to capitalize on past learning. For example, con- 
sider the problem of teaching;. children to .identify .(receptive language) 
and name (productive language) the primary colors. Initially, none 
of the children could identify or name more than one color accu!> 
rately. After only two sessions, our records indicated that five 
children had made rapid progress in color identification and naming. 
These children were then advanced to more challenging tasks, while 
the remaining children continued the elementary review on color con- 
cepts. This was a deliberate attempt to maximize the use of the 
child’s time since the "Readimobile Preschool" only lasted four hours 
each week. This was, of course, the essence of some experiments in 
individually prescribing instruction (ERIE, 1968) and the approach 
taken in computer assisted instruction (Hansen, 1966). In this re~ 
gard, our daily diagnosis and structured approach to preschool educa- 
tion was instituted to insure that these children in four hours per 
week had more opportunities for specific learning than children in a 
conventional preschool setting that meets three hours daily or fifteen 
hours per week. 

II* External Evaluation. The external evaluation represents the 
more traditional approach in which children are assigned to 
groups, given or withheld a treatment (independent variable), 
and then the effects of the experimental or control placement 
are assessed (dependent variable). The children were evalu- 
ated in May and June of 1969, using the following instruments: 



Intelligence: 


X,' Stanford - Binet 


Language : 


Illinois Test of 
^ Psycholinguist ic Abilities 
(Revised form, 1968) 


Behavior Inventory: 


" Caldwell Preschool 
Inventory 


Cognition: 


^ Englemann’s and Bereiter's 
'' Concept Inventory Scale 


School Readiness: 


Metropolitan Readiness 
. Tes ts 
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The external evaluation did not follow a random assignment 
of Ss to treatment groups and a pretest-posttest design for two 
reasons. First, the group con^ositlon was determined by where the 
Readlmoblle stopped, and there was no opportunity to randomly 
assign children to location. Second, pretests were not administered 
because- there were no funds available for pretesting. It is probably 
true thet the lower-class black children in rural Wakulla, Leon and 
Gadston Counties form a relatively homogenous group since poverty is 
so widespread in Northern Florida among rural blacks. 

Particular caution was exercised in evaluating the distal 
control subjects. Much research exists en^haslzlng that non- 
intellectual variables, such as rapport between the examiner and 
child, markedly Influence children's responses in testing situations 
(Berelter & Engelmann, 1966; Click, 1968; Zlglerj & Butterfield, 1968) 

The following precautions were taken to ensure valid test 
results: 

1. A team of experienced examiners was hired. 

2. The race and sex of the examiner was the same as the 
child's race and sex. 

3. The Readlmoblle children (Croups 1, 2 and 3) were 
tested at their usual preschool sites. 

A. The control children were tested in son suitable 
location In their homes. (An atten^t was made to 
test the first two control children in a near-by 
elementary school, but the children became upset 
and did not respond well to the test items.) 

5. Each child received a maximum of A5 minutes of 
testing per day to avoid fatigue and restlessness. 
Frequeut rest breaks were also provided. 

6. The examiner devoted the amount of time necessary 
to establish rapport with each child. Particular 
caution was used with the control children. 



Three of the Instruments, the Stanford-Blnet, ITPA, and the 
Caldwell Preschool Inventory were administered a second time to each 
child. The purpose of the second administration was to determine 
the test-retest reliability with this particular population. The 
second administration followed within one month of the first 
administration of each instrument. 
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111* Teacher Evaluation* The teacher evaluation consisted Of dire^:t 
observation of their behavior in the structured curriculum 
setting, Group 3* The fundamental question was: Can bright 

high school graduates ^o are highly motivated be taught the 
principles of behavior modification and how to implement a 
^packaged" preschool curriculum* The teacher training program 
was as follows: 

1* Jxdactic - orientation . ‘.This included reading and dis- 
cussion of the use of behavior modification principles 
(Madsen & Madsen, 1969), needs of the socio-economically 
deprived preschool child, and rationale for the Peabody 
Lessons* 

2* Role modeling * During September and October, the 

research director (Parker) and the observers (Jennings 
and Lewy) demonstrated how each lesson was to be used 
with children* After that time, the teachrrs were 
responsible for introducing the lessons* 

3* Planning daily activities * After four loohths (September, 
October, November, December) the teachers slowly assumed 
mof^ and more of the responsibility f6r planning and 
sequencing each day's activities* 



Records were kept on how often the research director or 
observers had to "intervene" with' constructive criticism or were 
asked by the teachers for help* Obviously, the goal w^s for the 
teacViers to become c<»itpletely autonomous in selecting and implement- 
ing the materials* This research doctunents how long it takes for 
this type of paraprofessional to be trained in the use of behavior 
modification techniques and "packaged" curricula* 
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RESULTS 



Throughout the resiainder of this paper the following code 



will be used to differentiate 
controls . 


the curricula' groups 


and their 




Experimental 


Control 


General Enrichment 


GE 


GE-C 


Feabody - 3 months 


F3 


F3-C 


Feabody - 9 months 


F9 


F9-C 



Analysis of variance tables are in the appendix. Tables 
sunmarizing the Duncan's Multiple Range Test are included in the 
text. 



Administration of Dependent Measures 

The Binet, ITPA, and Caldwell were administered as posttests 
on two separate occasions in order to determine the stability (i.e. , 
reliability) of these test scores on this population of £s. Table 1 
presents the test*retest reliability coefficients between the first 
and second administrations of the Binet, ITPA, and Caldwell total 
batteries and subtests. It is clear that all of the coefficients 
are large and statistically significant. 

In order to carefully examine the group mean scores, a 
2x3x2 analysis of variance was coiqnited on each dependent measure. 
Each analysis included the following variables: Treatment (Experi- 

mental vs. Control) x Curriculum (G£, F3, F9) x Administration- 
(First Administratiou vs. . Second Adniinistration). Tables 21, 22, 
and 23 sumnarize the results of these analyses. 

The results can be briefly sunmarized as follows: (1) the 

experimental ^s were superior on all measures on both occasions to 
the control ^s; (2) the treatoent groups differed significantly 

from one another (these two findings are to be thoroughly discussed 
later in the results section); (3) the £s in all groups scored 
significantly higher on the second administration of^~the measures 
than on the first administration; and (4) there was a significant 
curriculum x administration interaction on the Caldwell measure. 
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TABLE 1 



Test-Retest Reliability Coefficients 
Between First And Second Administrations 



Total Batteries 

Stanford-Binet .9.093 
Illinois Test of Fsycholinguistic Abilities .9061 
Caldwell .8621 



Subtests of the Illinois Test of Fsycholinguistic Abilities 

Auditory Reception . .5926 - 

Visual Reception .5281 

Visual Sequential Memory .5781 

Auditory Association .7848 

Auditory Sequential Memory .8238 

Visual Association .6525 

Visual Closure .7040 

Verbal Expression .6842 

Granmatical Closure .5267 

Manual Expression .7457 

Auditory Closure .7305 

Sound Blending .4855 



Subtests of the Caldwell Freschool Inventory 

1. Fersonal-Social Responsiveness .7362 

2. Associative Vocabulary .6658 

3. Concept Activation-Numerical .8082 

4. Concept Activation-Sensory .8215 



jj < .05 if r^ *288 
p < .01 if r2 .372 
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Since the in all groups scored higher on the sec»>nd 
administration of the measures than on the first administration^ 
a comparison of the mean scores- for the groups on each measure 
should be enlightening. On the Binet, the IQ scores for the 
experimental ^s were 9^7.00 and 100.58; the control ^s scored 
86.79 and 90.92. In each case the gain was approximately 4 IQ 
points. On the ITPA^ the raw scores for the experimental ^s 
were 136.50 and 154.71; the control's* mean scores were 114.17 
and 129.00. The gains for the experimental and control ^s were 
approximately 18 and 15 raw score points respectively. On the 
Caldwell, the scores for experimental ^s were 49.20 and 53.88; 
the control ^s mean scores were 41.04 and 45 <54. While the gains 
were approximately 5 points for both the experimental and control 
Ss, the interaction between the curricula*, groups and the admini* 
stration of the Caldwell provides the opportunity for a more re- 
fined examination of these data. Figure 1 presents this inter- 
action^ revealing a dramatic increase in performance of the F3 
group between the first and second administration of the Caldwell. 

All groups improved in performance on the second admini* 
stration of Binet, ITFA, and Caldwell; *therefore, the subsequent 
analyses will use scores obtained on the second administration 
of these tests. 



Stanford-Binet Intelligence Quotient 

An analysis of variance of the Stanford-Binet IQ scores 
revealed that there were main effects of treatment and curriculum. 
There was almost a_10 point difference between the meaj^s of the 
treatment groups (X = 100.58) and the control groups (X - 90.92). 
In Figure 2 the mean IQ of each of the six groups is depicted. 

The Duncan's New Multiple Range Test was applied to the 
means o^ the six groups and is summarized in Table 2. The. GE 
group (X - 106.13) scored significantly higher than the F3 group 
QC == 93.00), the F3-C group (X 87.38), and the F9-C group 
(X = 84.63). However, the GE group_did not score significantly 
h^her than its own control gro^ (X = 100.75) or the F9 group 
(X s 100.63). The GE*C group (X s 100.75) scored significantly 
higher than either Feabody control group. There was no signifi- 
cant difference between the F9 group and the GE group. 

These results reveal differences in the effectiveness of the GE 
and F9 curricula on their respective populations. The children 
involved in the GE curriculum did not score significantly higher 
on the Stanford-Binet than did their controls, while children in 
the F9 curriculum did score significantly higher than their con- 
trols. Since the mean IQ's of the two Feabody control groups were 
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TOTAL CALDWELL SCORE 



51 



— • Second Admin. 
0---0 First Admin. 




CURRICULUM 



Fig. 1. A comparison of the three curricula groups, 
including their respective control groups, on the first and 
second administrations of the Caldvell Preschool Inventory. 
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Fig. 2. A comparison of the three curricxtla groups ami 
their control groups on mean Stanford**Binet 10 scores. 
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TASIS 2 



Binet IQ - Second Administration 



Duncan's New Multiple Range Test 
of Differences Between Means 



5 

i 








P9-C 


P3-C 


P3 


P9 


GE-C 


GE 


Means 




84.63 


87.38 


93.00 


100.63 


100.75 


108.13 


P9-C 


84.63 




2.75 


8.37 


16.00** 


16.12** 


23.50** 


P3-C 


87.38 






5.62 


13.25* 


13.37* 


20.75** 


P3 


93.00 








7.63 


7.75 


15.13** 


P9 


100.63 










.12 


7.50 


G£-C 


100.75 












7.38 






P9-C 


P3-C 


P3 


P9 


GS-C 


GE 




Any two 


oieans not 


underscored 


by the 


same line are 


significantly 



different. 

Any two means underscored by the same line are not significantly 
different. 

i ^ 

■'* p < .05 

** p < .01 
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significantly lower than the mean IQ of the GE~C group, it is of 
note that (1) the F3 and P9 groups were not significantly differ* 
ent from the GE*C group and (2) the 79 group was not significantly 
different frmn the GE curriculum group as well as the GE~C group. 



Illinois Test of Fsycholinguistic Abilities 

An analysis of variance of the total ITFA scaled scores in* 
dicated thetr there ve re main effects of treatment and curriculum. 
The mean for the treatment group was 396^67 and for the control 
group 356.79 ^ncan's Multiple Range Test (Table 3) shows that 
the GE group (X = 477.13) scored significantly higher than all 
other groups. The GE*C group scored significantly higher than 
both Peabody control groups and the F3 group. However, the scores 
of the GE*C group (X = 415.75) and the P9 group ^ = 376'. 13) were 
not significantly different. Thus it appears that both the GE and 
the 79* curricula were effective in increasing language skills. 

Figure 3 illustrates the comparison of i:he mean total ITFA 
scaled score for each curriculum group and control group. ITFA 
scaled scores rather than psycholinguistic ages are used because 
the examiner's manual for the ITFA gives composite psycholinguistic 
age norms based only on 10 subtests rather than on the 12 subtests 
comprising the total ITFA test battery used in this study. 



Subtests of the ITFA" 

Figures 4, 5 and 6 compare each curriculum group with its 
control group on the twelve subtests of the Il^A. It can be seen 
in Figures 4 and 5 that the GE group and the 'F^* group had a higher 
mean profile than did their respective control groups. Figure 6 
demonstrates fhat the F3 group did not have a higher profile than 
its control group. Apparently, the Feabody curriculum did not sig* 
nificantly increase language skill when implemented for only three 
months . 



Figure 7 compares the profiles of the three curricula groups. 
The GE group obtained the highest mean profile. The 79* group ob- 
tained a slightly lower profile and the 73 group had the lowest 
mean profile. However, it is interesting to note the similarity of 
the 79 profile and the G2-C profile (Figure 8). 

Analyses of variance were applied to scores fr<mi each of the 
subtests, and where significant effects were indicated, the Duncan's 
Multiple Range Test was used. 






TABLE 3 



Total ITPA Scaled Score - Second Administration 
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Duncan's New Multiple ^nge Test 
of Differences Between Means 



Means 




P3-C 

329.00 


P9-C 

325.63 


P3 

336.75 


P9 

376.13 


415.75 


GE 

477.13 


P3-C 


329.00 




6.63 


7.75 


47.13 


86.75** 


148.13** 


P9-C 


335.63 






1.12 


40.38 


80.12** 


141.50** 


P3 


336.75 








39.38 


. 79.00** 


140. 38** 


P9 


376.13 










39.62 


101.00** 


GE-C 


415.75 












61.38* 



P3-C 



P9-C 



P3 



P9 



^-C 



GR 



Any two means not underscored by the same line are significantly 
different. 

Any two means underscored by the same line are not significantly 
different. 



* P < ..05 

** p < .01 
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CURRICULUM 



Fig» 3» A cumpari^on o£ the mean total LTPA scaled 
scores for each curriculum group and its control group* 
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Fig, 4, A comparison of the means of the General Enrichment group and its control gtoup 
on the 12 suhtests of the ITFA, 
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Pig. 6. A comparison of the means o£ the Peabody 3-month group and its' control group 
on the 12 subtests of the ITPA. 
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Fig* 7* ComparltonB of the means of the General Enrichment, the Peabody 9-month, and 
the Peabody 3-month groups on the 12 sub tests of the ITPA* 
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Fig. 8. A comparison of the means of the Peabody 9-month group and the General Enrich- 
ment control group on the 12 sub teats of the ITPA. 



Itie Auditory Reception subtest analysis revealed ^ main 
effect of curriculum. Table 4 shows that the GE group (X - 38.75) 
scored significantly higher tjun the F3 group (X = 30.75) and 

both Peabody control groups (X's: P3-&s32.00j .P9-032.38). 

However, the GE group, the P9 group, and the GE-C group were not 
significantly different. 

There were no significant differences between groups on 
the Visual Reception subtest. 

The analysis of the Auditory Association subtest revealed 
significant differences between curricula grot^s. The Duncan's 
test in Table 5 indicates that the GE group (X = 37^00) scored 
significantly higher than both Peabody control groups r(X's: 
P3-C«29.63, P9-C-28.25) and the P3 group (X = 28.88). However, 
the GE group did not deomonstrate better auditory association 
than the GE-C group or the P9 group. 

The Visual Association analysis indicated a main effect of 
treatment. Table: 6 shows that the GE group (X = 40.75) scored 
significantly higher than all other groups except for the~P9 group 
(X = 38.00). The P9 group scored significantly higher than either 
Peabody control group (X's: P3-C«30.00, P9-C«30.75). 

A mpin effect of treatment was indicated on the Verbal 
Expression subtest. As Table 7 shows, all curricula groups 
scored higher irhan all control groups. The only significant 
difference revealed by the Duncan's test ms between the P9 
group (X = 39.38) and its control group (X = 33.13). 

♦ 

On the scores of the Manual Expression subtest, the analy- 
sis of variance* indicated ^ significant effect of treatment 
(Table 8). The GE group (X = 40. 1^) scored significantly higher 
than both Peabody control groups (X's;.‘ P3-C^32.88, P9-Os32.88). 

There were no significant differences between treatment 
or curricula groups on the Grammatical Closure subtest. 

The Visual Closure analysis showed main effects of both 
treatment and curriculum. The Duncan's indicated a significant 
difference between the GE group (X ^ 61.25) and all other groups 
(Table ^)*_ There was also a significant difference between the 
P^ group (X = 48. 1^) and its control group (X = 39*. 25). 

A main effect of curriculum was revealed by the analysis 
of' the Auditory Sequential Memory ^ubtest. The Duncan's in 
Table 10 shows that the P9 group (X = 42.50) scored significantly 
higher than any of the control groups or the GE group. 
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TABLE 4 



Auditory Reception Scaled - 
Second Administration 

Duncan's New Multiple Range Test 
of Differences Between Means 







P3 


P3-C 


P9-C 


G£-C 


P9 


GE 


Means 




30.75 


32.00 


32.38 


35.50 


35.63 


38.75 


P3 


30.75 




1.25 


1.63 


4.75 


4.88 


8.00** 


P3-C 


32.00 






.38 


3.50 


3.63 


6.75* 


P9-C 


32.38 








3.12 


3.25 


6.37* 


G£-C 


35.50 










.13 


3.25 


P9 


35.63 












3.12 






P3 


P3-C 


P9-C 


G£-C 


P9 


G£ 



Any two means not underscored by the same line are significantly 
different. 

Any two means underscored by the same line are not significantly 
different. 

* p < .05 

** p < .01 
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TABLE 5 

Auditoxy Association Scaled - 
Second Administration 

Duncan's New Multiple Range Test 
of Differences Between Means 







P9-C 


P3 


P3-C 


P9 


GE-C 


GE 


Means 




28.25 


28.88 


29.63 


32.00 


32.88 


37.00 


P9-C 


28.25 




.63 


1.38 


3.75 


4.63 


8.75** 


P3 


28.88 






.75 


3.12 


4.00 


8.12* 


P3-C 


29.63 








2.37 


3.25 


7.37* 


P9 


32.00 










.88 


5.00 


GE-C 


32 .«8 












4.12 






P9-C 


P3 


P3-C 


P9 


(X*C 


GE 




Any two 


oieans not 


underscored 


by the 


same line are 


s ignif ica nt ly 



different. 

Any two means underscored by the same line are not »ig^~^icantly 
different. 

* p < .05 
** p < .01 
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TABLE . 6 

Visual Association Scaled - 
Second Administration 

Duncan's New IHultiple Range Test 
of Differences Between Means 



F 

? 

i 

: 



i 



1 ^ 

r 

i- 



Means 




P3-C 

30.00 


P9-C 

30.75 


P3-C 


30.00 




.75 


P9-C 


30.75 






P3 


32.75 






GE-C 


33.63 






?9 


38.00 







P3-C P9-C 



P3 

32.75 


GE-C 

33.63 


P9 

38.00 


6E 

40,75 


2.75 


3.63 


8.00** 


10.75** 


2.00 


2.88 


7.25** 


10.00** 


f ' 


.88 


5.25 


8.00** 






4.37 


7,12* 








2.75 


P3 


GE-C 


P9 


6E 



I Any two means not underscored by the- same line are significantly 

I different. 

I Any two means underscored by the same line are not significantly 

different. 



* p < .05 

** p < . 01 
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TABLE 7 



Verbal Expression Scaled - 
Second Administration 



Duncan's New Multiple Range Test 
of Differences Between Means 







P9-C 




P3-C 


P3 


GE 


P9 


Means 




33,13 


33,50 


34.63 


35.25 


37.13 


39.38 


P9-C 


33.13 




.37 


1.50 


2.12 


4.00 


6.25* 


GE-C 


33.50 






1.13 


1.75 


3.63 


5.88 


P3-C 


34.63 








.62 


2.50 


4,75 


P3 


35.25 










1.88 


4.13 


GE 


37.13 












2.25 






P9-C 


®-C 


P3-C 


P3 


GE 


P9 



Any two means not underscored by the same line are significantly 
different. 

Any two means underscored by the same line are not significantly 
different . 



* p < .05 
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TABLE 8 



Manual Expression Scaled - 
Second Administracion 



Duncan's New Multiple Range Test 







of 


Differences 


Between Means 










P9-C 


P3-C 


P3 


GE-C 


P9 


GE 


Means 




32.88 


32.88 


35.25 


36.63 


38.13 


40.13 


P9-C 


32.88 




o 

o 

* 


2.37 


3.75 


5.25 


7.25* 


P3-C 


32.88 






2.37 


3.75 


5.25 


7.25* 


^ P3 


35^.25 








1.38 


2.88 


4.88 


GE-C 


36.63 










1.50 


3.50 


P9 


38.13 












2.00 


f 




P9-C 


P3-C 


P3 


GE-C 


P9 


GE 



Any two means not underscored by the same line are significantly 
different. 

Aliy two means underscored by the same line are not significantly 
different. 




* p < .05 
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Visual Closure Scaled ~ 
Second "Administratldn 



Duncan's New Multiple Range Test 
of Differences Between Means 



■ 


Means 




P9-C 

39.25 


P3-C 

40.50 


P3 

42.37 


GE-C 

43.75 


P9 

48.13 


GR 

61.25 




P9-C 


39.25 




1.25 


3.12 


4.50 


8.88* 


22.00** 


[ 

r 


P3-C 


40.50 






1.87 


3.25 


7.63 


20.75** 




P3 


42.37 








1.38 


5.76 


18.88** 


F 

\ 


^-C 


43.75 










4.38 


17.50** 


1 


P9 


48.13 












13.12** 








P9-C 


P3-C 


P3 


^-C 


P9 


GE 





r 

Any two means not underscored by the same line are significantly 
different. 

I, 

Any two means underscored by the same line are not significantly 
different. 

i 

\ 

[ * p< .05 

: ** p < .01 

i: 
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TABLE 10 



Auditory Sequential Memory Scaled - 
Second Administration 



Duncan's New Multiple Range Test 
of Differences Between Means 



Means 




ge 

31.13 


GE-C 

31.75 


P9-C 

34.75 


P3-C 

35.38 


P3 

36.63 


P9 

42.50 


GE 


31.13 




.62 


3.62 


4.25 


5.50* 


11.37** 


GE-C 


31.75 






3.00 


3.63 


4.88 


10.75** 


P9-C 


34.75 








.63 


1.88 


7.75** 


P3-C 


35.38 










1.25 


7.12* 


Pe 


36.63 












5.87 






GE 


^-C 


P9-C 


P»3-C 


P3 


P9 



Any two means not underscored by the same line are significantly 
different. 

Any two means underscored by the same line are not significantly 
different. 

* p < .05 

** p < .01 
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In the Visual Sequential Memory analysis effects of_both 
treatment and curriculum were significant. The GE group (X = 40.13) 
scored significantly higher than both Peabody control groups and 
the P3 group (Table 11). There was no significant difference be* 
tween the GE group and its control group or the P9^ group. 

Type of curriculum produced significantly_different scores 
on the Auditory Closure subtest. The GE group (X = 35.88) scored 
significantly higher than all groups except its control group 
(Table 12). 

Hiere were no significant differences among the groups on 
the Sound Blending subtest. 

To summarize the analysis of the ITPA: 

1. The GE group scored significantly higher than 
its control group on: 

A. Visual Closure 

B. Visual Association 

C. Total Score 

2. The P9' group scored significantly higher than its 
control group on: 

A. Visual Association 

B. Verbal Expression 

C. Visual Closure 

D. Auditory Sequential Memory 
B. Visual Sequential Memory 

3. The "F3 group did not score significantly higher than 
its control group. 

4. The GE gro.up scored significantly higher than the 
PV treatment and control groups on: 

A. Visual Closure 

B. Auditory Closure 

C. Total Score' 

The P9 group scored significantly higher than the 
GE group on Auditory Sequential Memory^ 

5 . The GE group scored significantly higher than the 
^ treatment and control groups on: 

A. Auditory Reception 

B. Auditory Association 
C^ Visual Association 

D. Visual Closure 

E. Visual Sequential Memory 

F. Auditory Closure < 

G. Total Score 

6* There was no significant difference between Ihe GE control 
children and 'the P9 group except for Audifory Sequential 
Memory^ on which the P9 group scored significantly higher. 



TABLE 11 



Visual Sequential Memory Scaled - 
Second Administration 



Duncan's New Multiple Range Test 
of Differences Between Means 



Means 




P9-C 

27.63 


P3 

28.75 


P3-C 

31.00 


^-C 

34.50 


P9 

35.38 


GE 

40.13 


P9-C 


27.63 




1.12 


3.37 


6.87* 


7.75** 


12.50** 


P3 


28.75 






2.25 


5.75* 


6.63* 


11.38** 


P3-C 


31.00 








3.50 


4.38 


9.13** 


GE-C 


34.50 










.88 


5.63 


P9 


35.38 












4.75 






P9-C 


P3 


P3-C 


GE-C 


P9 


GE 



Any two means not underscored by the* same line are significantly 
different. 

Any two means underscored by the same line are hot significantly 
different. 



* p < .05 

** p < .01 



38 



TABLE 12 



Auditory Closure Scaled - 
Second AdministTation 

Duncan's New Multiple Range Test 
of Differences Between Means 



Means 




P3-C 

29.63 


P9-C 

30.25 


P3-C 


29.63 




.62 


P9-C 


30.25 






P3 


30.25 






P9 


30.37 








32.88 







P3-C P9-C 



P3 

30.25 


P9 

30.37 


GS-c 

32.88 


6E 

35.88 


.62 


.74 


3.25 


6.25* 


o 

o 

* 


.12 


2.63 


5.63* 




.12 


2.63 


5.63* 






2.51 


5.51* 








3.00 


P3 


P9 


6E-C 


GE 



Any two steans not underscored by the sane line are significantly 
different. 

Any two means underscored by the same line are not significantly 
different. 



* p < .05 
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Factor Analysis of the ITPA 



The raw scores of the 12 subtests of the Illinois Test of 
Fsycholinguistic Abilities were subjected to a principle compo* 
nents analysis ^ich was followed by a varimax rotation. A value 
of 1*0 was chosen to be the coiomonality estimate and was the 
value placed on the diagonals of the correlation matrix. The 
number of factors subjected to the varimax rotation consisted of 
those factors ^ose eigenvalues were equal to 1.0 or greater. 

This resulted in a three-factor solution to the problem. 

Factor 1 accounts for 47% of -the 'Variance and can be identified 
as a visual factor. Factor 2 raises the cumulative proportion 
of the total variance to 57% and can be identified as an audi- 
tory factor. The third factor again raises the cumulative pro- 
portion of the total variance to 66% and can be identified as a 
closure factor. 

F 

Table 13 gives the factor loadings as a result of the 
varimax rotation for the three-factor solution. This table 
contains only those factors whose loadings were .60 or greater 
as these represented the variables ^ich v;ere relatively inde- 
pendent Of the other two factors. Loadings below this .60 value 
tended to be distributed among two and also among three factors. 



TABLE 13 

Factor Analysis of ITPA Raw Scores 
(11=48) 



Factor 1 


Factor 2 


Factor 3 


.82 Vis. Assoc. 


.87 Aud. Seq. Memory 


.84 Aud. Closure 


.73 Vis. Recept. 


.72 Sound Blending 


.68 Aud. Assoc.. 


.65 Manual Expr. 




.63 Gramn. Closure 


.60 Vis. Closure 




.60 Vis. Seq. Mem. 



Visual 



Auditory 



Closure 



Caldwell Preschool Inventory 

An analysis of variance of the total Caldwell score re- 
vealed ^in effects of treatment but not of curriculum. The 
mean of the experimental group was 53.'66j thus exceeding the 
control group mean of 45.54. !Hie Duncan's New Multiple Range 
Test was applied to the differences between the means of the 
t^tal scores and is sumnarized in Table 14. The P9-C grou^ 

(X = 41.88) scored_slgnlficantly lower than the F9 group (X =56.63) 
and che GE group (X = 56.75). There were no significant differ- 
ences between curricula groups on the total score. 



TABLE 14 



Total Caldwell - Second AdninistTation 



Duncan's New Multiple Range Test 
of Differences Between Means 



Means 




P9-C 

41.88 


GE-C 

44.63 


P3 

48.25 


P3-C 

50.13 


P9 

56.63 


G£ 

56.75 


P9rC 


41.88 




2.75 


6.37 


8.25 


14.75* 


14.87* 


GE-C 


44.63 






3.62 


5.50 


12.00 


12. U 


P3 


48.25 








1.88 


8.38 


8.50 


P3-C 


50.13 








4 


6.50 


6.62 


P9 


56.63 












.U 






P9-C 


GE-C 


P3 


P3-C 


P9 


G£ 



Any two means: not underscored by the sane line are significantly 
different. 

Any two means underscored by the saise line are not significantly 
different. 



* p < .05 ' 
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Each of the four subtests of the Caldwell was analyzed 
individually. An analysis of Subtest 1, Persona l‘>Social Re‘> 
sponsivenessj indicated a main effect of treatment. A Duncan's 
Test is summarized in Table 15. The P9 group (X - 22.00) scored 
significantly higher than the P9-C group ^ = 15.63) and the 
GE-C group (X = 16.63). The P3-C group (X = 19.63) scored sig- 
nificantly higher than the'P9~C. "There was no significant dif- 
ference between the three curricula groups. 

On Subtest 2 , Associative Vocabulary, and Subtest 3, 

Concept Activation-Numerical, an analysis of variance revealed 
no main effects of treatment or curriculum. 

Subtest 4 is Concept Activation-Sensory. An analysis 
revealed main effects of treatment but not curriculum. The 
mean for the treatment group was 13.46 as compared with a mean 
of 10.29 for the control groyp. The Duncan's test is sun^rlzed 
in Table 16. The P9 group (X = 14.25.) and the 6E group (X = 14.00) 
scored significantly higher than any of the control groups 
(X's: GE-C=10.25, P3-C=10.38, P9-C=10.25). There were no 

significant differences between the three curricula groups or 
between the three control groups. The GE and T9 curricula are 
seemingly effective in increasing sensory concept activation as 
measured by this subtest. 




Englmnann .Concept Inventory Scale 

There were no significant'81fferences revealed on'the analysis 
of variance of the tot»l score of the Englemann test. The scores of 
Subtest 2 indicated "that all the groups scored, significantly higher 
than the P9^C group (Table 17). On Subtest 3, the GE group scored 
significantly higher^tfaan either uf the Peabody control groups 
(Table 18). Generally speaking, all the children had a low rate of 
correct responses on this test; therefore, the test did not differ- 
entiate between groups. 



Metropolitan Reading Readiness Test , 

The analysis of variance of the 'Metropolitan scores showed 
that there was a main effect of curriculum but not treatment. The 
results of the Duncan's test (Table 19) indicated that the P3 and P3-C 
groups scored significantly higher than thh~T9' group, the GE-C group, 
and the P9-C group. The mean of the G£ group was below the means of 
the F3 and F3-C group and above the means of the other groups. It 
should be noted that all of the scores were very low, with a difference 
of only 6.12 points between the highest and lowest means. 
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TABLE 15 



Caldwell - Second Administration 
Subtest l^^.;fersonal-Social Responsiveness 



Duncan's New Multiple Range Test 
of Differences' Between, Means 







P9-C 


G£-C 


G£ 


P3 


P3-C 


P9 


Means 




15.63 


16.63 


18.63 


19.50 


19.63 


22.00 

A 


P9-C 


15.63 




1.00 


3.00 


3.87* 


4.00* 


6.37** 


G£-C 


16.63 






2.00 


2.87 


3.00 


5.37** 


G£ 


18.63 








.87 


1.00 


3.37 


P3 


19.50 










.13 


2.50 


P3-C 


19.63 












2.37 






P9-C 


G£-C 


G£ 


P3 


P3-C 


P9 



Any two means not underscored by the same line are significantly 
different. 

Any two means underscored by the saoie line are not significantly 
different. 

* p < .05 

** p < .01 
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TABLE 16 
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Caldwell t Second Administration 
Subtest 4: Concept Activation-Sensory 



Duncan's New Multiple Range Test 



? 






of Differences 


Between Means 










• 


P9-C (^-C 


P3-C 


P3 




P9 




Means 




10.25 10.25 


10.38 


12.13 


14.00 


14.25 


f. 

J 


P9-C 


10.25 


.00 


.13 


1.88 


3.75* 


4.00* 


: 


(^-C 


10.25 


- 


.13 


1.88 


3.75* 


4.00* 




P3-C 


10.38 






1.75 


3.62* 


3.87* 


! 

: 

r 


P3 


12.13 








1.87 


2.12 




GE 


14.00 










.25 


1 






P9-C GE-C 


P3-C 


P3 


GE 


P9 


- 

* 




Any two 


means not underscored by the 


same line 


are significantly 




different. 












i 




. Any two 


means underscored by 


the same 


line' are 


not significantly 



different. 



* p < .05 
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TABLE 17 



Englemann - Subtest 2 

Duncan's New Multiple Range Test 
of Differences Between Means 



Means 




P9-C 

13.75 


P3-C 

20.88 


GE-C 

21.50 


P9 

21.63 


P3 

22.75 


GE 

23.75 


P9-C 


13.75 




7.13* 


7.75* 


7.88* 


9.00** 


10.00** 


P3-C 


20.88 






.62 


.75 


1.87 


2.87 


GE-C 


21.50 








.13 


1.25 


2.25 


P9 


21.63 










1.12 


2.12 


P3 


22.75 












1.00 






P9-C 


P3-C 


GE-C 


P9 


P3 


GE 




Any two 


means not 


underscored by the 


same line 


are significantly 



different. 

Any two means underscored by the same line are not significantly 
different. 

* p < .05 

** p < .01 
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Englemann - Subtest 3 

Duncan's New Multiple Range Test 
of Differences Between Means 







)?3-C 


P9-C 




P9 


P3 


GE 


Means 




7.38 


7.50 


8.00 


9.00 


9.00 


11.25 


P3-C 


7.38 




.12 


.62 


1.62 


1.62 


3.87* 


P9-C 


7.50 






.50 


1.50 


1.50 


3.75* 


^-C 


8.00 








1.00 


1.00 


2.25 


P9 


9.00 










1.00 


2.25 


P3 


9..00 












2.25 






P3-C 


P9-C 




P9 


P3 


GE 




Any two 


means not 


underscored by the 


same line 


are significantly 



different. 

Any two means underscored by the same line are not significantly 
different. 



* p < .05 



TABLE 19 



Total Metropolitan * First Advlnistration 



Duncan's New Multiple Range Test 







of 


Differences 


Between 


Means 












P9 


P9-C 


GE 


P3-C 


P3 


Means 




20.13 


21.50 


21.88 


22.63 


25.75 


26.25 




20.13 




1.37 


1.75 


2.50 


5.62* 


6.12** 


P9 


21.50 






.38 


1.13 


4.25* 


4.75* 


P9-C 


21.88 








.75 


3.87* 


4.37* 


GE 


22.63 










*3.12 


3.62 


P3-C 


25.75 












.50 








P9 


P9-C 


GE 


P3-C 


P3 



Any two oieans not underscored by the same line are significantly 
different. 

Any two means underscored by the same line are not significantly 
different. 



* p < .05 

** p < .01 



A main effect of curriculum was evident in the analysis of 
Subtest 1, the only sub test which revealed any significant dif- 
ferences. The ^ncan's test (Table 20) indicated that both P3 
and P3-C groups scored significantly higher than the GE, GE-C,, 
and F9 groups. In addition, the P3 group scored significantly' 
higher than the P9-C group. 

This test proved to be inappropriate for our population. 
The children were not able to perform any of the test items if 
the test was given in groups with general instructions for each 
subject. For this reason, the test was administered to each 
child individually, and directions for each test item were given. 
Thus, the validity of the results is questionable.:. 



TABLE 20 



Metropolitan Reading Readiness Test - Subtest 1 

Duncan's New Multiple Range Test 
of Differences Between Means 









P9 


GE 


P9-C 


P3-C 


P3 


Means 




4.88 


5.25 


6.00 


6.38 


8.25 


9.63 


^-C 


4.88 




.37 


1.12 


1.50 


3.37** 


4.75** 


P9 


5.25 






.75 


1.13 


3.00** 


4-38** 


G£ 


6.00 








.38 


2.25* 


3.63** 


P9-C 


6.38 










1.87 


3.25** 


P3-C 


8.25 












1.38 






GE*C 


P9 




P9-C ' 


P3-C 


P3 



Any two means not underscored by the same line are significantly 
different.' 

Any two means underscored by the same line are not significantly 
different. 



* p < .05 

** p < .01 
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DISCUSSION 



. It will be. .helpful to precede the discussion of the external 
evaluation with some comments on the use of paraprofessionals , the 
Peabody materials, and the internal evaluation* 

After three months of careful observation and feedback to our 
paraprofessional teachers, they were performing admirably* They 
quickly understood the principles of behavior modification and the 
importance of,precise recording of a child's responses to particular 
tasks* We were lucky to have teachers fdio were bright, flexible, 
and appreciated constructive criticisms* It is probably more dif- 
ficult to work with some professionally trained "traditional" early 
childhood educators who would actively resist the use of structured 
learning materials and behavior modification techniques* It was, 
however, very cOstly in terms of time fgr either observers or the 
project director to monitor the daily performance of the teachers 
and hold daily conferences with them concerning how they could im- 
prove their teaching skills* the Southeastern Educational Laboratory 
is presently using a sophisticated preservice training program for 
paraprofessional teachers rather than relying exclusively on an in- 
service training program* 

j In general, the Peabody materials accompanying Level iS^P 
possess two strengths: - (1) they are very easy for paraprofes- 
sionals to use, and (2) the children found the lessons interesting* 

It should be recognized that we did not use the materials as they 
were designed -- i*e*, a maximum of one lesson per day -- but 
covered as many lessons as possible each day for a concentrated 
teachi^- learning session* this massed practice approach probably 
decreased the effectiveness of the lessons; obviously it would' have 
been better, for example, to distribute the four hours of structured 
learning in group P9 across five, days but the overall schedule of 
the Readimobile program made this impossible* 

Our criticisms of the Peabody Level #P center arouud three 
issues — (1) lesson objectives, (2) stimuli, and (3) organization 
of lessons* Since the lesson objectives are not made clear to the 
teacher it was hecessai^y for us to isolate the specific lesson 
objectives or goals ourselves, the Southeastern Educational Lab 
is currently expanding the' present recording system to include 
lesson objectives, a coding scheme, and a performance checklist* 
this approach will enable the teacher to keep accurate records 
Jierself on each child's progress through the Peabody lessons* 



In order to devise a compact Instructions! "kit" the devel- 
opers of the Peabody #P made some mistakes in the stimuli they 
selected. Only two exan^les are required to illustrate the problem. 
First, the same cards are' used to teach color, size, and number 
rather than separate stimuli that would not be confounded on each 
of the other dimensions. Dur children were very confused until we 
resorted to "homemade" stimuli. Second, the records that accompany 
the materials have a major fault — the recordings are very brief 
and an individual song is recorded only once. Since numerous ex- 
posures were required for the children to learn the songs, the 
teacher had to leave the group frequently to reset the recording. 

It would have been far better if each song had been recorded about 
five times. 

The organization of the Peabody has two "flaws" which 
could be easily corrected. First, we are not convinced that 
enough consideration (or research) has been given to the sequenc- 
ing of the lessons. Second, a frequency count of the type of 
lessons (e.g. , classification, following directiona, etc.) re- 
veals that far more considerat ' >n is given to some activities at 
the expense of others. In general, we would reconmend* more acti- 
vities for each "goal" and a more equitable distribution of acti- 
vities across "goals." 

The internal evaluation was designed to establish specific 
instructional goals or objectives for each lesson and to record 
ever;/ child's verbal and nonverbal responses as related to a 
particular instructional goal. (A sample performance recording 
sheet is included in the appendix.) to accosplish this task, two 
observers were present each day for the P9 group. After satis- 
factory (r* .95) interobserver reliabilities were obtained, each 
observer recorded the verbal and nonverbal behavior of four chil- 
dren. These responses were coded as either correct or incorrect 
so that the teacher could tell after any lesson how well the 
children had mastered the inatructional goals. This careful re- 
cording and' feedback to the teacher was probably one of the more 
valuable accomplishments of the project. If the children as a 
group did miserably, we would carefully examine the lesson or 
method of presentation and modify our approach. If an average 
child had not reached the criterion for successful performance, 
we could examine the lesson, method of presentation and/or repeat 
the lesson at a later date. Unfortunately, this evaluation does 
not approach the ideal of completely individualizing instruction; 
nevertheless, it assures that most of the children will succeed, 
and it guarantees that the teachers will have accurate records 
of the children's behavior. 
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Recognizing the previously mentioned problems of subject 
selection and experimental design, an examination of the results 
section dealing with the external evaluation reveals three pri- 
mary findings' and several secondary results. The ^primary results 
may be briefly sumnarized as follows: (1) the increase in test 

score performance of all groups on the second administration of 
three dependent measures; (2) the superiority of the F9 and GE- 
cxperimentel groups over their control groups on some of the 
dependent measures; and, (3) the effectiveness of the P9 curricu- 
lum in eliminating some of the well-documented differences between 
black lower class and white middle class children. 

The increase in test score performance of all groups on the 
second administration of the Binet, ITPA and Caldwell can be inter- 
preted as the result of increased familiarity with the instrument 
and examiner. Zigler and Butterfield (1968) have cautioned against 
possible erroneous interpretations of changes in IQ scores. It may 
be that many reported IQ changes in preschool programs could be 
most parsimoniously interpreted as motivational and attitudinal 
changes rather than substantive cognitive changes. These data then 
add a neW' note of caution in interpreting change scores iriien using 
the ITPA and Caldwell. The interaction of treatment group and 
administration reported, on the Caldwell highlights another problem - 
different groups may experience differential profit from repeated 
testing on particular instruments. Frank Palmer of the Harlem 
Research Center in New York hai.^ exercised caution in his testing 
procedures to guarantee a positive rapport between the child and 
the examiner before any assessment begins. Br. Palmer discovered 
two very interest facts iriiile working with two- and three-year-old 
children. First, it may take 10-15 hours of contact between the 
examineir-'and' child before testing can begin. Second, the statisti- 
cally significant correlation of a child^s score on the Binet and 
the length of time before the child could be separated from his 
mother and testing could begin is high and negative. We should be 
concerned' with controlling these noncognitive factors that may 
adversely affect a child's performance in a testing situation. . 

The P9 and G£ experimental groups were superior to their 
control groups in several important instances. The P9 group was 
superior to its control group on all three of the major dependent 
measures — Binet, ITPA, and Caldwell. Additionally, the P9 was 
superior to its control group on five subtests of the ITPA: 

Visual Association, Verbal Expression, Visual Closure, Auditory 
Sequential Hemory, and Visual Sequential Memory. 
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The G£ group was superior to its control group on the total 
ITPA scores, two ITOA subtests (Visual Closure and Visual Associa- 
tion) and one Caldwell subtest (Concept Activation-Sensory). 

The lack of superiority of the P3 group on any of the depen- 
dent measures comparted to its control group is easily explained by 
the brief exposure to an educational curriculum. The actual 
instructional time was only 48 hours (4 hours per week for 12 weeks) 
so it is not surprising that their performance did not improve. 

This group can probably best be viewed as a contact control group 
rather than as a meaningful treatment group. 

The P9 group when coiq>ared to the GE or GE*C groups demon- 
strated the effectiveness of a structured preschool program in de- 
creasing some of the well-documented differences between black and 
white children of different socio-economic classes. There were no 
statistically significant differences between the black lower 
socio-economic P9 children and the two white middle class groups, 

6E and G£-C, on the total scores of the Binet or Caldwell. On 
the total ITPA the P9 group was inferior to the GE group but not 
significantly different from the GE-C group which scored hi^er. 
than the P9-C> P3, and F3-C groups. Addititahallyv'^he GE gfotip' 
was superior to the P9^C, P3, and P3-C groups 6n the total scores 
of the Binet and ITPA. We take these facts as support for the 
effectiveness of the P9 preschool program. 

Three secondary results merit a brief discussion. First, 
in general, there were no significant differences between or among 
the groups on two dependent measures — the Englemann Concept 
Inventory and the Metropolitan. An examination of the first 90 
lessons of the Peabody should have led us to the early conclusion 
that our curricula were not designed to improve performance on the 
Englemann and probably not on the Metropolitan. In addition to 
the content, the directions of the Metropolitan proved too difficult 
for our population. (Please don't ask the embarrassing question 
concerning why the P3 and P3-C groups did so well on the Ifetro- 
politan. ) The original intention was to test each child twice on 
the Metropolitan but the examiners were convinced that the second 
administration was a waste of time and money. ‘ 

A second interesting result was the high positive correla- 
tions among the Binet, ITPA, and Caldwell*, Obviously, 

it would be needless duplication for anyone in the future to use the 
Binet and the Caldwell together as general measures in evaluating a 
preschool program; they are so highly correlated that knowledge of 
one score provides enough information. It is time for either 
instrument developers to coae to the aid of preschool research or 
preschool research to adopt another approach to evaluation. We 
favor the latter suggestion. 
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Another set of potentially helpful results are those 
connected with the ITPA scores. The magnitude of our S^*s 
scores was high (e.g. , the subtests scores converted to psycho- 
linguistic age for the F9 group ranged from 5 years 6 months to 
8 years). Either we are dealing with children who are precocious 
psycholinguistically or the norms for the 1968 ITPA manual are, 
poor. He suspect the norms need in^rovement. The results of p\e 
factor airalysis'of the ITPA fell somewhere between the extremes 
of other research on the ITPA which finds only oue factor for 
black Southern children (see Don Steadman's .work from the 
Educational Improvement Program at Duke) or more factors than 
our three (studies which have usually used upper middle. olass 
suburban white children). 

In concluding the discussion section, comnents are in 
order about research needs in preschool education and approaches 
to Valuation of preschool programs. We strongly believe that 
research efforts which compare a treatment group and a distal 
control group using a pretest-posttest design are worthless. 

First, in a "successful" program, we don't know whether dif- 
ferences which appear are due to attitudinal and/or motivational 
changes rather than cognitive changes. Second, if these consider- 
ations are partially excluded by en^loying contact control groups 
or completely excluded using contact control groups and a Solomon 
Four group design, then it is impossible in these global inter- 
vention efforts to identify the antecedent conditions which 
produced the "success." 

I 

It appears that the mpst- promising approach will be for 
investigators to concentrate on developing and evaluating 
"con^nents" of an overall preschool "package." One might, for 
exan^le, take a component like "classification skills" which 
appear embedded in almost all global preschool efforts (e.g. , 

New Ikirsery, Deutsch, Weikart, etc.) and follow this simple 
approach: (1) identify the instructional: goals (e.g., classify^ 

geometric stimuli according to number, size, and color); (2) 
develop a classification skills instructional program using 
Gagne's task analysis approach and insisting on criterion per- - 
formance at every important step; and, (3) develop several pre- 
tests and posttests evaluative instruments. The pretests will 
be used for psychoeducational diagnosis to pinpoint the "entry" 
skills of each child and to aid in instruction. The posttests 
should contain several dusters of items: (1) an alternate form 

of the pretest designed to measure the terminal instructional 
objectives; (2) "near" transfer tests (problems which incorporate 
dimensions used in the instruction); (3) "far" transfer tests 
(problems which require the use of the same logical structure but 
have different specific content) ; a»l, (4) "farthest" transfer 
tests (problems presented in a different format and ‘varying in 
content) . 
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This **coinponent" rather than "package" approach has several 
attractive features: (1) it .''guarantees an operational statement 

of die "input” (the Peabody materials are one of the few packages 
that state clearly what the preschool teacher is to do); (2) it 
provides for a careful, enq>irical evaluation of each consonant 
with instruments that accurately pinpoint a child's achievement 
before, during, and after instruction; and, (3) it provides the 
preschool teacher with the freedom to select con^onents that are 
meaningful and important to her (ultimately, of course, research 
will identify the proper sequencing of conq>onents to attain a 
particular outcome). Components can be developed in muaerous areas 
including, for exanq>le, number skills, perceptual and auditory dis- 
crimination, ordering, problem solving, and social skills. After 
seeing so many terrible "lessons" on "the family" or "Homnies" 
presented in preschool classes, we are convinced that someone must 
develop as many conq>onents as soon as possible if programs like 
Head Start are to really be more than socilization experiences 
for the participants. We have completed one conq>onent on imltiple 
classification skills through all of the above steps; it is every 
difficult, time constuaing and costly approach. Its value, however, 
is that it is scientifically sound and may have a positive impact 
on preschool education. 
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APPENDIX A 



TABLE 21 



Analysis of Variance of Binet l.Q. 


Source 


df 


Sums of 
Squares 


Mean 

Square 


F 


Treatment (T) 


1 


2370.09 


2370.09 


. 12.4666** 


Curriculum (C) 


2 


4020.40 


2010.20 


10.5736*** 


T X C 


2 


484.19 


242.09 


1.2734 , 


Error 


42 


7984.81 


190.11 




Administration (A) 


1 


356.51 


356.51 


24.0320*** 


T X A 


1 


1.76 


1.76 


.1186 


C X A 


2 


11.52 


5.76 


.3883 


T X C X A 


2 


71.65 


35.82 


2.4147 


Error 


42 


623.06 


14.83 





** p < .01 

*** p < .001 



IVIBLE 22 



Analysis of Variance of Illinois Test 
of Psycholinguistic Abilities Raw Score 



Source 


df 


Sims of 
Squares 


Mean 

Square 


F 


Treatment (T) 


1 


13848.01 


13848.01 


6.3663* 


Curriculum (C) 


2 


35697.56 


17848.78 


8.2055** 


T X C 


2 


2887.77 


1443.89 


.6637 


Error 


42 


91358.31 


2175.20 




Administration (A) 


1 


6550.51 


6550.51 


86.6438*** 


T X A 


1 


68.34 


68.34 


.9039 


C X A 


. 2 


223.52 


111.76 


1.4782 


T X C X A 


2 


321.81 


160.91 


2.1283 


Error 


42 


3175.31 


75.60 





* p < .05 

** p < .01 

*** p < .001 
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